Point Transformer

Whegs Transformer

Transformer proteins

Proteins are generally believed to adopt a unique fold, defined by their amino acid sequence, under specific environmental conditions. These unique structures, in turn, endow proteins with one specific function. However, not all proteins obey the “1 amino acid sequence → 1 fold → 1 function” scheme. Moonlighting proteins that adopt one distinct threedimensional structure but can accomplish two ...

Image Transformer

Image generation has been successfully cast as an autoregressive sequence generation or transformation problem. Recent work has shown that self-attention is an effective way of modeling textual sequences. In this work, we generalize a recently proposed model architecture based on self-attention, the Transformer, to a sequence modeling formulation of image generation with a tractable likelihood....

Transformer in Grid

The aim of this research article is to determine the way to install surge arresters close to a power transformer to provide protection against lightning overvoltage. Depending on the length of the cables used in the installation, the insulation levels in base insulators of surge arresters and bushings of transformers change according to the voltage they support. For validation purposes, the vol...

Analog Wavelet Transformer Draft #

This paper describes the theory and implementation in CMOS technology of a circuit which performs analog wavelet decompositions of a one-dimensional (e.g., sound) input. The circuit is based on the Analog VLSI techniques described by Carver Mead in Analog VLSI and Neural Systems 1]. The analog wavelet outputs are the output of a logarithmically scaled set of bandpass lters; each band is sampled...